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Abstract 

Clausius introduced, in the 1860s, a thermodynamical quantity which 
he named entropy S. This thermodynamically crucial quantity was pro- 
posed to be extensive, i.e., in contemporary terms, S(N) oc N in the 
thermodynamic limit N — > oo. A decade later, Boltzmann proposed 
a functional form for this quantity which connects S with the occur- 
rence probabilities of the microscopic configurations (referred to as com- 
plexions at that time) of the system. This functional is, if written in 
modern words referring to a system with W possible discrete states, 
Sbg = — fcs Pi m Pi> with X^l^i Pi = 1, fes being nowadays called the 

Boltzmann constant (BG stands for Boltzmann- Gibbs, to also acknowl- 
edge the fact that Gibbs provided a wider sense for W). The BG entropy 
is additive, meaning that, if A and B are two probabilistically independent 
systems, then Sbg(A + B) = Sbg{A) + Sbg(B). These two words, ex- 
tensive and additive, were practically treated by physicists, for over more 
than one century, as almost synonyms, and Sbg was considered to be the 
unique form that S could take. In other words, the functional Sbg was 
considered to be universal. It has become increasingly clear today that 
it is not so, and that those two words are not synonyms, but happen to 
coincide whenever we are dealing with paradigmatic Hamiltonians involv- 
ing short-range interactions between their elements, presenting no strong 

* Invited review to appear in Concepts and Recent Advances in Generalized Information 
Measures and Statistics, edited by A.M. Kowalski, R. Rossignoli and E.M.F. Curado (Bcntham 
Science Publishers, 2011). 
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frustration and other "pathologies". Consistently, it is today allowed to 
think that the entropic functional connecting S with the microscopic world 
transparently appears to be nonuniversal, but is rather dictated by the 
nature of possible strong correlations between the elements of the system. 
These facts constitute the basis of a generalization of the BG entropy 
and statistical mechanics, introduced in 1988, and frequently referred to 
as nonadditive entropy S q and nonextensive statistical mechanics, respec- 
tively. We briefly review herein these points, and exhibit recent as well 
as typical applications of these concepts in natural, artificial, and social 
systems, as shown through theoretical, experimental, observational and 
computational predictions and verifications. 



1 Introduction 

In 1865, Rudolf Clausius introduced in thermodynamics a quantity S that, in 
analogy with the word energy, he named entropy. The basic motivation was to 
introduce an integrating factor in the differential transfer of heat SQ, so that 
it would become an exact differential. The relation is now referred to as the 
Clausius equality for quasi-stationary process, namely dS = T being the 
absolute temperature. Less than a decade later, Ludwig Boltzmann introduced 
a quantity which was defined in terms of the microscopic configurations of the 
system. This quantity gradually became identified as being a microscopic ex- 
pression for the Clausius entropy S. We refer hereafter to this quantity as Sbg, 
where BG stands for Boltzmann- Gibbs, thus acknowledging the great contri- 
bution of Gibbs to the same concept. This functional form constitutes one of 
the cornerstones of the celebrated Boltzmann- Gibbs (BG) statistical mechanics. 
For a discrete set of probabilities {pi}, it is given by 

w w w 

Sbg = -k^ptlnpi = fc^pjln— (^2 Pi = *) . (!) 

i=i i=i Pl i=i 

where W is the total number of possibilities, and k a positive conventional 
constant chosen once for ever (the most frequent choices are k = k B , or k = 1). 
If all probabilities are equal, we obtain the celebrated expression 

S BG = k\nW. (2) 

If the variable which characterizes the microscopic state of the system is a 
D-dimensional continuous one x, this expression is taken to be 

Sbg = ~k J dxp(x) lnp(x) = k J dxp(x) In — |-y ( J dxp(x) = l) , (3) 

and, if we are dealing with a quantum system, it is taken to be 

Sbg = ~k Trp In p = kTrp In - (Trp = l^j , (4) 



2 



where p is the density matrix. We shall indistinctively use here one or the other 
of these forms, depending on the particular point we are addressing. 

If our system is a dynamical one with an unique stationary state (a very 
frequent case), this state (referred to as thermal equilibrium, when we are deal- 
ing, in one way or another, with a macroscopically large amount of particles) is 
the one which, under appropriate contraints, maximizes Sbg- For example, for 
D = 1, if we happen to know (x) = J dx x p(x), the maximizing distribution is 
given by 

J ., 0>O), (5) 

where (3 is the corresponding Lagrange parameter. 

If (x) = 0, and we happen to know (x 2 ), the maximizing distribution is given 

by 

— ffx 2 

P{X)= Jdxe-P* 2 (/3>0) - (6) 

This Gaussian form is known to be consistent with the Maxwellian distribution 
of velocities for classical statistical mechanics, with the solution of the standard 
Fokker-Planck equation in the presence of a linear drift, and also with the Cen- 
tral Limit Theorem (CLT). The latter basically states that if we consider the 
sum Sn = ^2i—iX{ of N independent (or nearly independent in some sense) 
random variables {^i}, each of them having a finite variance, this sum con- 
verges for N —¥ oo, after appropriate centering and rescaling, to a Gaussian. 
This most important theorem can be proved in a variety of manners and un- 
der slightly different hypothesis. One of those standard proofs uses the Fourier 
transform, which we shall address later on. 

It is well known that the BG entropy is the one to be used for a wide and 
important class of physical systems, basically those whose (nonlinear) dynamics 
is strongly chaotic (positive maximal Lyapunov exponent for classical systems), 
hence mixing, hence ergodic. What can be done with the others? In particular 
with those that might be weakly chaotic, with vanishing maximal Lyapunov 
exponent? It has been proposed in 1988 [I] that the current statistical me- 
chanical methods can be extended for an even wider class of physical systems 
just by generalizing Sbg- This generalization is reviewed in Section II. Before 
addressing it, let us make a crucial remark. 

Let us consider a system whose total number of microscopic posibilities is 
given by W^ 1 - 1 , hence, using Eq. we have that 

w m w m 

21 — 1 i\ — 1 

Let us assume next that we have N such systems and that they are probabilis- 
tically independent, i.e., pjfj- 2 i N = Pi?P^ —Pu? s we straightforwardly prove 
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that 



W(N) W(N) 



is given by 



ii,i2,— ,»j 

s fl0 (^)=4^+4^ + ».+4 J S. (9) 

where 

W(J\T) = V^ (1) PF (2) ...T^ (Ar) . (10) 

It follows from Eq. ([9j that 5b g is addifweF] 

If the TV independent subsystems are equal we have that 

W(N) = [W W ] N , (11) 

and 

S BG (N)=NS BG (l)cxN. (12) 

Consequently the BG entropy of such a system is extensive since it satisfies the 
thermodynamical requirement that 

0< lim Sbg ( N ) < oo , i.e., S(N) oc N (N -> oo) . (13) 

What happens if the TV subsystems (or elements) are not strictly independent 
but only nearly so? In other words, what happens if, for example, the system 
satisfies the following relation? 

W(N)~/j, n (N -> oo; [i > 1) . (14) 

This is the case, at infinite temperature, of the Ising model with first-neighboring 
ferromagnetic interactions in any Bravais lattice, of the Lennard- Jones gas, and 
of a plethora of other important systems. For all systems satisfying Eq. (14), 
Sbg is extensive since definition (131 is satisfied. 

But what happens if we have very strong generic correlations? More specif- 
ically, if the following relation is satisfied? 

W(N) ~ N T (N -> oo; r > 0) . (15) 

We immediately verify that Sbg(N) — klnW(N) oc In TV, hence it is nonexten- 
sive for any system satisfying ( |15| ). In other words, it violates classical thermo- 
dynamics. It is to avoid such disagreable situation that we are led to generalize 
the BG entropic functional. 

*We are following the definition in [8] for entropic additivity, namely an entropy S is 
additive if, for two probabilistically independent systems A and B, S(A + B) = S(A) + S(B). 
Otherwise it is nonadditive. 
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2 Generalizing Boltzmann-Gibbs entropy and sta- 
tistical mechanics 



The generalization we are focusing here is based on the following entropy pQ: 

w w , . w 

q - 



1 _ q W W W 

S q = k ^=l^-=-fc^pfln 9 p i = fc^p i ln g - (^ Pt = l), (16) 



(17) 



and 

S q = -k Trp q In, p = fc Trp ln 9 - (Vrp = l) , (18) 
where q *E R, and 

z 1-9 — 1 

ln g z = — (In! z = In z) . (19) 

Eqs. fll6"] ), ( fl7| ) and ([18]) respectively recover Eqs. (!]), Q and |2} in the 



q — > 1 instance. This theory is currently referred to as nonextensive statistical 
mechanics [U [2 |3j 01 |5j [6l [7] . The entropy S q satisfies the following property: 
if A and B are two probabilistically independent systems, then 

S q {A + B) = S q (A) | S q (B) | g,(A)S g (2?) 

In other words, 5 9 is additive [8] for 9=1, and nonadditive for q ^ 1. 
Furthermore, if the probabilities are all equal, we have that 

S q = k\n q W. (21) 

In remarkable contrast with Sbg(N), S q (N) oc TV for q = 1 — 1/r for 



all systems satisfying (15). For suc/i complex systems, the additive entropy 
Sbg is nonextensive, whereas the nonadditive entropy S q is extensive for a spe- 
cial (system- dependent) value of q, and therefore thermodynamically admissible! 
Mathematical and physical examples can be seen in [TOl HH E] ■ We shall 
hereafter note q ent the value of q such that S q (N) oc N. So, if the system satisfies 



relation (14), we have q en t — 1, whereas if it satisfies ( |15[ ) we have q en t = 1 — ^. 
It is convenient to emphasize at this point that particularly complex systems 
might exist (and probably do exist) for which no value q exists such that S q is 
extensive. 

In the D = 1 continuous case, if an appropriate first moment of x is different 
from zero (see details in [3]), the extremization of S q yields 



e 



-fix 



P(x) = r ; _ px (q<2;p>0), (22) 



/ dxe. 
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where e z q is the inverse function of ln 9 z, more precisely 



e^[l + (l- g )z]|-' (ef = e»), (23) 

[...] + being equal to its argument when this is positive, and zero otherwise]^] 
Clearly Eq. (22 1 recovers Eq. ^ for the q — 1 particular case. 

If the appropriate first moment vanishes and we happen to know the appro- 
priate second moment, the extremization of S q yields, for the continuous case, 
the so-called g-Gaussian distribution 



e, 



P(s) = r - 0X 2 (9<3;/?>0), (24) 
J dxe q 

The g-Gaussian distributions]^] have a finite support for q < 1, and an infinite 
one for q > 1; for g > 1 they asymptotically decay as power-laws (more precisely 
like x~ 2 / ( '' ? ~ 1 - ) ); they have a finite variance for q < 5/3, and an infinite one for 
q > 5/3; they are normalizable only for g < 3. 

Around 2000 [IB], g-Gaussians have been conjectured (see details in [17] ) 
to be attractors in the CLT sense whenever the N random variables that are 
being summed are strongly correlated in a specific manner. The conjecture 
was recently proved in the presence of g-independent variables j20j [21] [22] [TH] 
H5] . The proof presented in [50] is based on a g-generalization of the Fourier 
transform, denoted as g-Fourier transform, and the theorem is currently referred 
to as the g-CLT. The validity of this proof has been recently challenged by 
Hilhorst [23] . His criticism is constructed on the inexistence of inverse q- Fourier 
transform for q > 1, which he illustrates with counterexamples. The inverse, 
as used in the [20 paper, indeed does not exist in general, which essentially 
makes the proof in [2B] a proof of existence, but not of uniqueness. The q- 
generalization of the inverse Fourier transform appears then to be a quite subtle 
mathematical problem. It has nevertheless been solved recently [23], and further 
considerations are coming [25] related to q- moments [26]. Work is in progress 
attempting to transform the existence proof in [20] into a uniqueness one. In the 
meanwhile, several other forms [251 HZ] of closely related g-generalized CLT's 
have already been published which do not use the inverse g-Fourier transform. 

Probabilistic models have been formulated [25J [30] which, in the N —> oo 
limit, yield g-Gaussians. These models are scale-invariant, which might sug- 
gest that g-independence implies scale-invariance, but this is an open problem 
at the present time. However, definitively, scale-invariance does not imply g- 
independence. Indeed, (strictly or asymptotically) scale-invariant probabilistic 
models are known [311 132j which do not yield g-Gaussians, but other limiting 



To be more explicit, e z q equals e z (Vz) if q = 1, vanishes for z < —1/(1 — 5) an d equals 

[l + (l-q)z] T ^i for z > -1/(1 -q) if q < 1, and equals [1 + (1 - q)z]^ for all z < l/(q-l) 
(value at which it blows up to infinity) if q > 1. 

3 Since long known in plasma physics under the name suprathermal or k distributions [13] 
if q > 1, and equal to the Student's t-distributions |14| for special values of q > 1. They are 
also occasionally referred to as generalized Lorentzians |15j . 
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distributions instead [33] ■ I n addition to all these, g-Gaussians are exact solu- 
tions of nonlinear homogeneous [34, 35, 36 ,137] as well as of linear inhomogenous 
Fokker-Planck equations [38 . In fact, these various cases have been recently uni- 
fied as particular cases of nonlinear inhomogenneous Fokker-Planck equations 

In Section 3 we remind some basic properties, and in Section 4 we briefly 
review various predictions, verifications and applications of g-exponentials and 
g-Gaussians through analytical, experimental, observational and computational 
methods in natural, artificial and social systems. However, before presenting 
them, let us make a few epistemological remarks. 

Physics differs from mathematics. Within the traditional methodology of 
theoretical physics, mathematical tools are quite frequently (and fruitfully!) 
used before their complete mathematical understanding is achieved on rigorous 
grounds. In Henri Poincare's words: Deviner avant de demontrerl Ai-je besoin 
de rappeler que e'est ainsi que se sont faites toutes les decouvertes importantes? 

B 

For example, up to now there is no theorem determining the precise necessary 
and sufficient conditions for a classical or quantum many-body Hamiltonian to 
be legitimately admissible in order to know with mathematical certainty that 
its thermostatistical equilibrium state is given by the celebrated BG weight. 
Nevertheless, physics has exhibited amazingly interesting results and progress 
by so doing in a relatively cavalier manner! 

As a second example, we are not aware of any mathematical proof (rigorous 
by definition!) that the expansions based on the entire set of Feynman diagrams 
do converge in general to the exact answer. The same can be said for the suc- 
cessive truncations within the BBGKY hierarchical scheme [ID]. In fact these 
two latter illustrations most probably have some deep relation with the so-called 
moment problem in theory of probabilities. This problem focuses on the neces- 
sary and sufficient conditions for a probability distribution to be completely and 
uniquely determined by the complete set of its momenta, even when they are all 
finite (see [2SJI3T] for cases where not all momenta are finite). Hundreds (maybe 
thousands) of useful developments in theoretical physics assume (sometimes ex- 
plicitly, but more often just implicitly) that the full set of momenta perfectly 
determines the distribution. This question is so subtle that, in mathematics, 
three different moment problems are normally discussed separately for various 
classes of support of the probability distribution, namely for the [0, 1] support 
(Hausdorff moment problem), the [0,oo) support (Stieltjes moment problem), 
and the (—00,00) support (Hamburger moment problem). General necessary 
and sufficient conditions are still ellusive [12 U3J HH 05] . 

However, the frequent lack of well established mathematical rigorous has 
never been a serious obstacle to the advancement of theoretical and experimental 
physics. We may once again quote Galileo: Nelle prove naturali non si deve 

4 Guessing before proving! Need I remind you that it is so that all important discover- 
ies have been made?, Henri Poincare, La valeur de la science, in Anton Bovier, Statistical 
Mechanics of Disordered Systems, (2006) page 218. 
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ricercare I'esattezza geometrical 

3 Some basic properties of S q 

We remind below some of the most basic properties of the S q entropy, besides 



the nonadditivity property shown in Eq. ( 20 1 . These properties are valid for all 
values of q, otherwise explicitly stated. For a more detailed list of the properties 
the reader can look at reference [6j. 

• Continuous dependence on the probabilites: The S q function depends con- 
tinuously on the microscopic probabilities. 

• Nul event: The addition of a new event with zero probability doesn't 
change the S q value for q > 0. For q < 0, by definition, the sum in Eq. 



( 16 ) runs only for states whose probability is positive. 



• Certainty: If one of the microscopic states has probability equal to one, 
the S q entropy equals to zero. 

• Non-negativity: S q ({pi}) > for any set of probabilities {pi}- 



Invariance with respect to the permutation of states: S q given by Eq. ( 16 1 



is invariant with respect to the permutation of all the states or, given by 



Eq. (18), is invariant with respect to unitary transformations. 



• Concavity: The entropy S q satisfies the property S q ({p"}) > \S q ({p'j}) + 
(1 - \)S q ({pi}) for p'l = \p[ + (1 - X)Pi, Vi (0 < A < 1), i.e., it is concave 
with respect to the probabilities for q > 0. For q < it is a convex function 
with respect to the probabilities. 

• Extremum: S q has its maximum value at equiprobability for q > 0. A 
simple proof can be seen by noticing that the function s(p) = (p — p q )/(q — 
1) is a concave function and that S q can be written like s (Pi)- As 
s(p) is a concave function, it satisfies Y,i Pi) = s (w) — W s (^) 
for any configuration {pi}. For equiprobability we have s(^Y^f w) = 
f Ef^W = s(l/W) > ^Y.Y s(pi), for any configuration {p t }. 
The last inequality implies that S q ({±}) = £f s(l/W) = Ws(l/W) > 

s{pi) = S({pi}) for any configuration {pi} other than equiprobability, 
showing that equiprobability cxtrcmizes S q |119j . The same reasoning can 
be used to show that, for q < 0, S q has a minimum at equiprobability as 
now the function s(p) — (p — p q ) / (q — 1) is a convex one. 

• Shannon additivity: The Shannon additivity is slightly modified. For a 
partition of the W microscopic configurations into two subsets A and B, 
containing respectively Wa and Wb configurations satisfying Wa + Wb = 



'In the natural proofs we should not search for geometrical exactness. 
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W , with respective probabilities {p%, • • • ,Pw A } an d {pw^+i, ■ 1 ■ ,Pw}, the 
well-known Shannon additivity turns out to be generalized as S q (pi, ■ ■ ■ ,pw) — 

S q (pA,PB) +Pa S q (pi/pA, ■ ■ ■ ,PW a /pa) +P% S q (pw A + l/PB, ' ' ' ,Pw/Pb), 

where, in the above expression, pa = 2i=iP« an d Vb = Ylj=w A +iPj- 
• Lesche stability: The entropy S q is Lesche-stable (see details in [6]). 

4 Applications 

Let us list here some of the many verifications and applications of the present 
theory (i.e., of the nonadditive entropy S q , and of its associated nonextensive 
statistical mechanics) that are available in the literature (see [46] for full bibli- 
ography), (i) The velocity distribution of (cells of) Hydra viridissima follows a 
g-Gaussian probability distribution function (PDF) with q = 3/2 [37]; (ii) The 
velocity distribution of (cells of) Dictyostelium discoideum follows a g-Gaussian 
PDF with q = 5/3 in the vegetative state and with q = 2 in the starved state [4"5] : 
(iii) The velocity distribution in defect turbulence [49]; (iv) The velocity distri- 
bution of cold atoms in a dissipative optical lattice [50] ; (v) The velocity distri- 
bution during silo drainage [5T] [52] ; (vi) The velocity distribution in a driven- 
dissipative 2D dusty plasma, with q = 1.08±0.01 and q = 1.05±0.01 at temper- 
atures of 30000 K and 61000 K respectively [53]; (vii) The spatial (Monte Carlo) 
distributions of a trapped 136 Ba + ion cooled by various classical buffer gases at 
300 K [54] ; (viii) The distributions of price returns and stock volumes at stock 
exchange, as well as the volatility smile [55J [55] [57] [55] ; (ix) Biological evolution 
[59"] ; (x) The distributions of returns in the Ehrenfest's dog- flea model [501 1ST] ; 
(xi) The distributions of returns in the coherent noise model [62) ; (xii) The dis- 
tributions of returns of the avalanche sizes in the self-organized critical Olami- 
Feder-Christensen model, as well as in real earthquakes [63]; (xiii) The distribu- 
tions of angles in the HMF model [53] ; (xiv) Turbulence in electron plasma [55] ; 
(xv) The relaxation in various paradigmatic spin-glass substances through neu- 
tron spin echo experiments [66) ; (xvi) Various properties directly related with 
the time dependence of the width of the ozone layer around the Earth [67] ; (xvii) 
Various properties for conservative and dissipative nonlinear dynamical systems 
[5J[I0[7J[7IJ[E1[75J[7J[E^ (xviii) The 

degree distribution of (asymptotically) scale- free networks [86, 87, 88, 89]; (xix) 
Tissue radiation response |90j ; (xx) Overdamped motion of interacting particles 
[9"T] : (xxi) Rotational population in molecular spectra in plasmas [92 ; (xxii) 
High energy physics [93] EH [95] ESI W\ EH EH H00j [Ml H02l [1031 HHH QU3 HQ6J ; 
(xxiii) Astrophysics [107] 1108) 1109] ; (xxiv) Analysis of the magnetic field in the 
solar wind plasma using data from Voyager 1 and Voyager 2 [1101 11111 1112] ; 
(xxv) Nonlinear generalizations of quantum and relativistic equations [113] . 
The systematic study of metastable or long-living states in long-range versions 
of magnetic models such as the Ising [114) and Heisenberg [115) ones, or in 
hydrogen-like atoms [116) 11171 IH8j . might provide further applications. 
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5 Final remarks 



The BG entropy and its associated exponential distribution for thermal equi- 
librium have been extended, during the last two decades, in the sense of ther- 
modynamics and statistical mechanics, into other forms. Stationary states have 
been discussed which correpond to the q- exponential form [T], logarithmic form 
[1191112(3] . stretched- exponential form 121 , as well as other, more general, forms 
[T2"2lfT2"3l . 

Let us make a comment on the results obtained in 123 . By using group 
entropies, general forms of entropies are found which correspond to various 
Dirichlet zeta functions. The simplest of these functions is the Riemann zeta 
function, which turns out to correspond to the entropy S q . This constitutes a 
rather striking and deep connection of nonextensive statistical mechanics with 
the theory of numbers. As a peculiarity it is also comes out in |123j that the q — > 
1 limit can not be straightforwardly implemented, thus making that the entropy 
Sbg remains outside the class with real g ^ 1 (a remarkable mathematical fact 
which also occurs in |122) !V 

While by all means interesting, the connection with the Riemann £ function 
established in |123| is not a full surprise. Indeed, in 1993, the possibility of some 
kind of such connection was raised (see Figure) in a very particular context, 
namely the g-partition function of a single quantum harmonic oscillator. Let us 
review this point. If we choose as zero energy the energy of the fundamental 
state, the spectrum of a single harmonic oscillator is given by 

E n = hum (n = 0,1,2,...), (25) 

hence the canonical g-partition function is given by 

71 = 

For q > 1, this expression becomes 

W) = £,7^ 

n=0 i 1 + (l - 
1 

(q - 1)/3Huj 
1 

(q - l)f3huj 

where £(s, Q) is the Hurwitz zeta function. The Riemann zeta function is given 
by 

n— 1 p prime 



(26) 



1 

1)/? hwn] ^ z 

oo 



l)/3 hu: 



I"" 1 n=0 \ L 

U<z-i)/ 



(27) 
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which establishes a connection with the prime numbers, thus with the theory 
of numbers. We notice also that here the q — > 1 limit is pathological, like in 
|122[ I123j . Clearly, the partition functions Z q of systems different from the 
harmonic oscillator are not necessarily going to exhibit any relationship with 
the Riemman zeta function. It is nevertheless a kind of amusing coincidence 
that this function already appeared before in connection with g-statistics. 

As a final comment let us state that it appears that BG entropy and statistics 
are sufficient but not necessary for thermodynamics. In other words, thermo- 
dynamics might well be more powerful than the role attributed to it by BG 
statistical mechanics. A question which then arises naturally is: What is the 
most general form of entropy which can be consistent with thermodynamics, 
more precisely with the zeroth, first, second, and third principles? What are 
the most general superstatistical forms [1241 11251 1126j which would correspond 
to this general entropy and statistics? By following in depth along the lines of 
|122l 11231 1127j , it might be possible to clarify this important — though hard — 
question. 
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Figure 1: First occasion when it became apparent that there was a connection 
between S q (hence g-statistics) and the Riemann £ function. I projected this 
slide during my lecture at the Workshop held, in 2-6 August 1993, in Mar del 
Plata, Argentina. The day before Michael Berry, in his own (wonderful) lecture, 
had emphasized that it would be very exciting if one could find fundamental 
connections of the prime numbers with physics. It is precisely such connection 
what the slide shows. 
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